Real-Time Micro VR Camera System

In this paper, a real-time virtual reality camera system for the micro environments has been developed with a dynamic focusing lens and a smart vision sensor using the \depth from focus" criteria. In the operation with a microscope, such as the micro-surgery, DNA operation and etc., the small depth of a focus makes bad controllability to actuate 3D micro objects with actuators. For example, if the focus is on the object, the actuator could not be seen in the microscope. On the other hand, if the focus is on the actuator, the object could not be observed. In this sense, the \all-in-focus image" is useful for the actuation in micro environments. However, one drawback on the all-in-focus image is that there is no information about the depth of objects. It is also important to reconstruct a micro 3D environment in real-time to actuate the object with the micro virtual environments. This paper discusses, rstly, the criteria of \depth from focus" to achieve the all-in-focus image and micro 3D reconstruction, simultaneously. Secondly, this criteria has been evaluated with o -line, simulation, with a usual camera system. Finally, a VR micro camera system has been developed to achieve the micro VR environments with the \depth from focus" criteria, i.e. the combination of the all-in-focus image and the micro 3D construction. This system is constructed by a dynamic focusing lens, which can change the focus in high frequency, and a smart vision system, which is capable in capturing and processing the image data in high speed with SIMD architecture.